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4bstract 


The  problem  of  hypothesis  testing  when  the  distribution  is  specified  only  up 
to  a  nuisance  parameter  is  considered.  A  test  is  said  to  be  adaptive  if  it  is 
asymptotically  optimal  regardless  of  the  value  of  the  nuisance  parameter.  The 
exponential  rate  of  convergence  to  zero  of  the  probability  of  type  II  error  when 
the  probability  of  type  I  error  converges  to  zero  exponentially  fast  at  a  fixed 
rate  is  used  as  the  optimal  criterion.  A  necessary  and  sufficient  condition  for  the 
existence  of  adaptive  test  is  obtained.  / Av,  'v  -  i 
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1  Introduction 


Let  x  =  (xi, b e  n  independent,  identically,  distributed  observations  on  a 
random  variable  X  having  distribution  P  or  Q.  It  is  desired  to  test  the  null  hy¬ 
pothesis  that  X  has  distribution  P  versus  the  alternative  that  X  has  distribution 

Q ■ 

Let  4>n  =  d>„(x)  be  any  test  function.  Let  A  be  a  non-negative  number.  As 
in  Tusn&dy  (1977),  a  sequence  of  test  functions  {<£„}  is  said  to  have  exponential 
rate  A  if 

limsup^oo  Ep<f>n  <  1,  when  A  =  0,  ^ 

limsupn_0O  n-1  log  Ep<f>n  <  —A,  when  A  >  0. 

Let  $A(P)  be  the  set  of  all  sequences  of  tests  that  have  exponential  rate  A.  Let 

B(A,P,Q)  =  —  inf{lim  mf  n~l\ogEQ(l  -  <j>n)  :  {<M  €  $A(P)}.  (1.2) 

In  other  words,  B(A,P,Q)  is  the  optimal  exponential  rate  at  which  the  proba¬ 
bility  of  type  II  error  can  converge  to  zero.  A  sequence  of  tests  {</>„}  in  $A(P)  is 
said  to  be  asymptotically  optimal  if 

liminf  n-1  logPo(l  —  <f>n)  =  -B{A,  P,Q). 

n— ♦  oo 

Let  the  densities  of  P,Q  be  denoted  by  p(x),q{x)  respectively.  It  is  assumed 
that  EP(q(x)/p(x)y  <  oo  for  all  t.  It  is  known  that  (see  Bahadur  (1971))  if 
lim„_oo  Ep<f>n  =  a,0  <  a  <  1  (so  that  the  sequence  of  tests  {<^„}  is  of  exponential 
rate  0),  then  B(0,P,Q)  =  K(P,Q)  where  K{P,Q)  =  EP\og(p(x)/q{x))  is  the 
Kullback-Leibler  information  number. 

When  A  >  0,  it  is  shown  in  Blahut  (1974),  Tusn&dy  (1977),  and  Birge  (1981) 


where  C  is  determined  by 


-  A  =  inf  <  — tC  +  log  Ep 
»>o 
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Futhermore,  if  0  <  A  <  K(Q,P),  then  B  =  B(A,P,Q )  >  0  and 


A  =  B  +  C. 
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A  similar  notion  of  asymptotic  optimality  for  composite  hypotheses  has  been 
investigated  in  Bahadur  (1960),  Hoeffding  (1965),  Brown  (1971),  Tusnddy  (1977) 
and  Birg£  (1981). 

Now  assume  that  the  distributions  P  and  Q  are  not  determined  exactly, 
but  only  up  to  a  finite-valued  nuisance  parameter  r,r  =  1 ,...,/.  For  example, 
a  message,  in  one  of  l  posssible  languages  using  the  same  alphabets,  is  to  be 
transmitted  through  a  noisy  channel  n  times  and  a  choice  has  to  be  made  between 
two  possible  messages  or  rather  the  probability  distributions  associated  with  the 
messages,  without  knowing  which  language  is  used.  Another  example  is  that 
there  are  l  measurement  types  and  for  each  type  a,  the  measurement  has  two 
possible  distributions  Pa  and  Qa .  Thus,  one  has  to  test  Pa  versus  Qa  with  a 
unknown. 

Let  Ai, . . . ,  Ai  be  fixed  positive  numbers.  A  test  <j>„  is  called  an  adaptive  test 
if  it  is  an  asymptotically  optimal  test  of  rate  Aa  for  each  value  of  the  nuisance 
parameter  a.  That  is,  <f>%  is  adaptive  if  for  each  a, 

limsup^oo  n-1  log  Ep4>%  <  -Aa  and 
liminfn_oo  n-1  logPg(l  —  $“)  =  —B(Aa,Pa,Qa). 

The  existence  of  adaptive  tests  of  rate  0  has  been  investigated  in  Rukhin 
(1982,1986).  A  necessary  and  sufficient  condition  for  the  existence  of  such  a  test  is 
that  K(Pa,Qp)  >  K{Pp,  Qp)  for  all  a,().  It  is  shown  in  section  2  that  for  adaptive 
tests  to  exist,  any  two  distributions  Pa,Qp,a  ^  /?  cannot  be  more  ‘difficult’  to 
distinguish  than  Pa,Qa •  Here,  ‘difficulty’  in  distinguishing  two  distributions  is 
measured  by  the  rate  of  convergence  of  the  type  II  error.  When  an  adaptive  test 
exists,  it  is  shown  that  a  weighted  likelihood  ratio  test  with  weights  depending 
on  the  rates  of  convergence  of  the  type  I  and  II  errors  is  always  adaptive.  An 
overall  maximum  likelihood  ratio  test  may  not  be  adaptive. 

2  Condition  for  the  Existence  of  Adaptive  Tests 

Let  pa(x),qa(x)  be  the  densities  of  Pa,Qa  respectively.  Let  Ai,...,Ai  be  posi¬ 
tive  constants  and  denote  B(Aa,Pa,Qp),  C[Aa,  Pa,  Qp)  by  Bap,  Cap  respectively. 
Also,  let  rjj(t\Pa,Qp)  =  Ef,{qp{x) / pa{x))* .  Assume  that  x()(t\Pa,Qp)  <  oo  for 
all  t,  for  all  a,  /?.  Note  that  il>(t\Pa,Qp)  is  the  moment  generating  function  of 
log(^(z)/pa(x)),  thus  by  the  finiteness  assumption,  rp(t\Pa,Qp)  is  strictly  convex 
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and  differentiable,  indeed  differentiation  can  be  carried  out  under  the  expectation 
sign.  Let 


T  -  T  M  -  ]n<r  maXa  enfla°  giM 

8  max,,  n"=i  Pa(xj) ' 

Let  4>n  —  <pn(x)  be  a  test  with  critical  region  given  by  Tn  >  0,  i.e. 


(2.1) 


4>n  = 


1  ifTn>0 
0  otherwise. 


(2.2) 


Theorem  2.1  Assume  that  0  <  Aa  <  min p  K(Qp,Pa),  for  all  a.  If  Bpa  >  Ba 
for  all  (3,  a ,  then  4>n  is  an  adaptive  test. 

Proof.  We  first  show  that  4>n  has  exponential  rate  Aa  for  every  a.  Since, 


Ep<f>n  <  Pa  (n_1  ^  "  >0 


< 


(n 

0=1  V 


-i max/9  rij=i 

n”=i  Pa (*i) 
-1,.  enB^  n”=1  gftfcy) 
enA“  Il^=i  Pa{xi) 


log  -■  >  0 

enAa 


<  l  ■  max  Pa  n_1  ]T)  log  ^E^LL  >  Aa  -  B00  (  , 
*  V  j=i 


and 


Pa  ^T1  £  log  >  Aa  -  B^j  <  e~nt(Aa~Bfif) 

for  any  f  >  0,  it  follows  that, 


E°P 


1lf{X) 

Pa  (®) 


Ep<f>n  <  l  ■  m^mU-nt^-B^m\Pa,Q0))n- 

p  t>0 


Therefore, 


limsupn  1  log  Bp  <t>n  <  maxinf{-t(Aa  -  B^)  +  log  V»(f  |P»,  Q,s)} 

n— co  0  *>° 

<  max  inf {~f(Aa  -  Ba0)  +  log0(f|P„,Q/j)} 
=  -Aa 


as  Aa  -  Ba/?  =  Cq^  by  (1.5). 
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Since  <f>n  is  a  test  of  exponential  rate  Aa  for  each  a,  to  show  that  4>n  is  an 
adaptive  test,  it  is  enough  to  show  that  liminfn_oo  n_1  log-Eg(l  —  <f>n )  <  -Baa. 
Now, 


Eq{  1  -  <t>n)  <  l  •  max  Qa  n-1  log 


.Pfifa) 


2_s  l°S  ~r~~T  >  ~  AP 

j=\  9a  l1;) 


and  so,  by  a  similar  argument,  one  obtains 


lirninf  n  MogJS^l  -  <£„)  <  maxinf{-t(Baa  -  Ap)  +  log  rp(t\Qa,  P0)}.  (2.3) 


Since  the  function  log rp(t\Qa,Pp)  is  strictly  convex,  there  exist  0  <  t0  <  1  such 
that  —  Bpa  =  t0Cpa  +  logrp(t0\Qa,Pf}).  Therefore, 


mf*>o{  t(Baa  -  Ap)  +\ogtl){t\Qa,Pp)} 

<  -t0{Baa  -  Ap)  +  logip(t0\Qa,Pp) 

=  —  Baa  +  (l  —  to)Baa  4-  toAp  —  Bpa  —  to(Ap  —  Bp  a) 
=  —Baa  +  (1  —  to)[Baa  —  Bpa) 

<  ~Baa. 


Thus,  from  (2.3),  liminfn_00  n  Uogi?£(l  —  <f>n)  <  —Baa,  for  all  a  and  <f>n  is  an 
adaptive  test.  □ 


A  necessary  condition  for  the  existence  of  adaptive  tests  is  obtained  by  consid¬ 
ering  the  asymptotic  behaviour  of  the  most  powerful  test  of  the  simple  hypothesis 
n"=i  Pa(xj)  versus  the  simple  alternative  wa  I]"=i  9<*(Zj)  +  t up  I]”=1  qp (zy) ,  c*  ^  /?, 
where  wk  =  enhk/(enba  +  enifi),k  -  a,0,  and  ba,bp  are  real  numbers. 

For  the  remainder  of  this  section,  we  assume  that  Pa,  Qa  are  absolutely  con¬ 
tinuous  with  respect  to  the  Lebesgue  measure  for  all  a.  Let  Qn  denote  the  dis¬ 
tribution  with  density  wa  riy=i  9a(zy)  +  wp  I"Iy=i  9p{xj)-  Let  </>“  be  the  following 
likelihood  ratio  test  : 


1  ,f —  n;',p.w - £e- 


0  otherwise, 


where  c„  is  a  constant. 


Lemma  2.1  For  a  fixed  a,  if  lim„_oo  n  1  log  Ep<f>°  =  —  Aa,  then 


Jim  n  1log^i>(l  -  <£“)  =  max(6t  +  pak{ba,bp,C))  -  b, 


i 
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where  pak{ba,b0,C )  =  inf,,t>0{s(C  -  ba)  +  t{C  -  bp)  +  log  ( ff{ff ) a ( fj{f} ) 4 }  and 

C  =  max*=ai/9(Ca*  +  6*),  5  =  max(6a,6^). 

Proof.  We  first  show  that  the  assumption  implies  that  limn-,,*,  cn  =  C  —  b.  From 
the  definition  of  <£“,  one  obtains 


Jim  n  1  log  Ep4>n 


<  lim  inf  n  1  log  Pa  (  n  1  log  2  •  max  to*  TT  >  c„ 

-  n-*oo  ^  k=a,fi  f^PciXj) 


<  max  lim  inf  n  1  log  Pa  [  n  1  Y'  log  ^  |  >  cn  —  bk  +  +n  1  log 

~  k=a,f)  n-oo  ^  ~  pa(Xj) 

<  max  inf{— t(C  -bk  +  l)  +  \ogtp(t\Pa,Qk)} 

k—a,P  t> 0 

where  w  =  e"*"  +  e'^C  =  limsup^^  c„.  Therefore,  inft>0{— t(C  -  bk  +  b)  + 
\ogil)(t\Pa,Qk)}  >  inft>0{— fCat  +  IogvK<[Pa,<2fc)}  for  k  =  a  or  (3.  This  implies 
that  C  —  bk  +  b  <  Cak,  for  k  =  a  or  /?,  i.e. 


w 

2 


C  <  max(Cat  +  bk )  -  b. 

k=a,p 


(2.4) 


Also,  Ef>4>°  >  Pa{n  1  logu;*;  Ily=i(9fc(a:j)/pa(a:j))  >  c„)  for  k  =  a  and  (3.  Thus 
Ep<f>“  >  max  Pa  f  n_1  ^  Iog  -  c"  “  bk  +  n_1  log  w  )  • 

k=a-B  V  1= 1  ) 

Using  a  similar  argument  as  above,  one  obtains,  for  A;  =  a  and  /?, 

inf{-tCa*  +  log0{t|Pa,<5*)}  >  inf{-f(£  -bk  +  b)  +  logrp{t\Pa,Qk)}, 


where  C  =  liminf,,-.;*,  c„.  Hence,  Cak  <  C  —  bk  +  b  for  each  k,  i.e 

C  >  max  (Cat  +  bk)  -  b. 

t=a,/S 

Equations  (2.4)  and  (2.5)  imply  that  limn_00  c„  =  C  —  6.  Now, 

Eq(1-4>“)  <  Qk  In"1  log  max  u;*  JJ  <  c„  ] 

\  k~a'B  ,=1  Pa(xj)  J 

=  Qk  ( n_1  log  -  <  cn  -  6t  +  n"1  log  w,k  =  a,  (3 


(2.5) 


(2.6) 
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s 
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Similarly, 

Eq(  1  ~  4>n)  >  Qk  Zjlo8  pk^~)  <  Cn  ~  ^  +  n_1  ]°g^'k  =  a,/?j  '  (2‘7) 

Applying  Theorem  5.1  of  Groeneboom  et  al.  (1979),  (2.6)  and  (2.7)  imply  that 
Jim  n"1  log  E%(1  -  4>°)  =  pak{ba,bfi,  C ) 
for  k  =  a,  0.  Since  £gn(l  -  <£")  =  iuQ.Eg(l  -  </>“)  +  u;^jEg(l  -  </>"),  we  have 
lim  n_1  log  £.5  (1  -  <£“)  =  max  lim  n-1  logu/ki?A(l  -  <j>V\ 
and  the  result  follows.  □ 

Since  <£"  is  the  most  powerful  test  of  njAuPafo)  versus  u;a  n”=i  9a(z>)  + 
u>/3  n"=i  9/5 (i ;),  this  yields  the  following 

Corollary  2.1  For  any  test  <f>'n  such  that  limsup^^  n~l  log  Ep<f>*n  <  -Aa,  for 
a  fixed  a 

max(6k  +  liminfn-1logEg(l  -  <£;))  >  max  (6*  +  pak(ba,  bg,  C)) 
for  any  0  —  1 ,...,/  and  any  6i, . . . ,  6/. 

Corollary  2.2  pak[ba,bg,C)  >  -B{Aa,Fa,Qk),k  =  a,/?. 

Proof.  As  shown  in  the  proof  of  lemma  2.1,  limn_oo  rc-1  logit^"  =  —  -da  implies 
that  limn_0o  n_1  log£g(l  -  <£“)  =  pak(ba,bg,C )  for  /:  =  a,0.  Since,  as  a  test  of 
Pa  versus  Qk,<?>n  has  exponential  rate  A,,  the  result  follows  from  (1.2).  □ 

Theorem  2.2  If  an  adaptive  test  exists,  then  for  all  a,0 

Baa  <  Bpa. 

Proof.  Let  be  an  adaptive  test.  Since  <£“  satisfies  the  condition  in  corollary 
2.1,  by  letting  ba  =  Baa  and  bg  =  Bgg,  one  obtains 

0  =  ma x{Bkk  -  Bkk)  >  ma x(Bkk  +  pak{Baa,  Bgg,C)), 

k~a,p  k=a,p 

i.e.  pak{B  aa *  Bp0,C)  <  —Bkk  for  k  =  a,0.  But,  from  corollary  2.2,  with  k  = 
0,Pa0{Baa,Bgg,C)  >  —Bap,  so  that  Bgg  <  f?a/s.  Since  a,0  are  arbitrary,  the 
result  follows.  □ 

Hence  from  Theorems  2.1  and  2.2  we  have  established 
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Corollary  2.3  If  Pa,Qa  are  absolutely  continuous  with  respect  to  the  Lebesgue 
measure  for  all  a,  then  an  adaptive  test  exists  iff  for  all  cc,  /?, 

Baa  <  B0a.  (2.8) 

From  the  proof  of  theorem  2,  we  see  that  if  an  adaptive  test  exists,  then 
pap{Baa,Bpp,C)  <  -Bpp  for  all  a,0.  Suppose  that  Pa  =  Q0  for  some  a 
0.  Assume  that  Ap  satisfies  the  condition  in  theorem  2.1,  in  particular  A0  < 
K(Q0,  Pp),  i.e.  B0P  >  0.  Consider 

Pap{B  aa  5  Bpp,C) 

=  +  ~  B +  lo^  fcffj)’  (sm)'} 

>  inf  js(C  —  Baa)  +  log Eq  |+inf{t(C-^)}.  (2.9) 

The  second  term  of  (2.9)  is  zero  because  C  —  Bpp  =  maxjt=a i0{Cak  +  Bkk)  -  B00  > 
Ca0  >  0  when  Pa  =  Q0.  Let  f{s )  be  the  function  in  the  paranthesis  of  the 
first  term  in  (2.9).  Then  /'( 0)  =  C  —  Baa  +  Eq  \ogpa(x)/qa(x)  =  C  —  Baa  + 
K(Pa,Qa)>Caa  -f  K(Pa,Qa)  >  o.  Since  f[s)  is  a  convex  function,  this  implies 
that  inf„>o  f[s)  =  0.  That  is  pap{Baa,BPp,C)  =  0.  But,  by  assumption  B00  >  0, 
and  inequality  paP{Baa,  BPP,C)  <  -Bpp  is  impossible,  and  hence  adaptive  test 
cannot  exist.  This  yields 

Corollary  2.4  If  Pa  —  Qp  for  some  a  ^  0,  then  an  adaptive  test  does  not  exist. 

Remarks.  1.  If  Pa  =  P  for  some  P  for  all  a,  then  (2.8)  always  holds,  i.e.  an 
adaptive  test  always  exists. 

2.  By  interchanging  the  roles  of  Pa,Qa >  we  can  define  a  similar  notion  of 
adaptation,  i.e.  a  test  is  adaptive  if  the  type  II  error  converges  to  zero  at  a 
guranteed  rate  while  the  type  I  error  converges  to  zero  at  the  optimal  rate.  Thus 
a  test  with  the  following  properties: 

limsup  n-1  log  ££(1  —  <t>n)  <  —  Aa  and 

n— »oo 

liminf  n-1  log  Ep<f>n  =  -B{Aa,Qa,Pa) 

fl — *  OO 

exists  iff 

B{Aa,Qa,Pa)  <  B{A0,Qp,Pa),  for  a, 0  =  1,...,/.  (2.10) 


g  I’ |  |'|  |  i 


It  is  easy  to  see  that  limx^—o+  B{Ap,  Qp,Pa)  =  K[Qp,  Pa ).  Thus,  by  setting  Ai  — 
•  ••  =  At  =  0,  i.e.  by  letting  the  type  II  error  converges  to  a  positive  constant, 
condition  (2.10)  becomes  K(Qa,Pa)  <  K(Qp,Pa).  This  result  is  obtained  in 
Rukhin  (1986). 

3.  Corollary  2.3  can  be  extended  to  the  case  when  the  nuisance  parameter 
has  countably  many  values.  Assume  that  inf p  K{Qp,Pa)  >  0  and  0  <  Aa  < 
mtpK{Qp,Pa)  for  every  a.  Let  {&„}  be  a  non-decreasing  sequence  such  that 
n_1  log  kn  — ♦  0  as  n  — ►  oo.  Consider  the  following  test: 

,.  f  1  if  n-1  log  >  0 

0  otherwise. 

Using  corollaries  2.1  and  2.2,  it  is  clear  that  if  an  adaptive  test  exists,  then  (2.8) 
holds  for  all  a,0.  We  claim  that  <£*  is  an  adaptive  test  if  (2.8)  holds.  We  first 
show  that  4>'n  is  a  test  of  rate  Aa  for  every  a.  Pick  n  large  enough  so  that  a  <  kn, 
then 

From  the  proof  of  theorem  2.1.  inft>o{e_‘*A“_B^V(t \Pa,  Qp)}  <  e~Aa ,  for  any  0. 
Thus, 

limsupn-1  log  Ep<f>'  <  lim  n_1  log  kn  —  Aa 

n— >oo  n— >oo 

=  -A*. 

Now,  we  show  that  type  II  error  of  the  test  <j>'n  converges  to  zero  at  the  optimal 
rate.  Using  the  same  argument  as  above 

lim  inf  n_I  log  Eq(\  -  <£*) 

n— *oo  v  v  *' 

<  sup  inf{— t(J5aa  -  Aff)  +  log  rp{t\Qa,Pp)}  +  lim  n-1  log  kn 

0  t>U  n — »oo 

<  ~Baa. 

Hence,  d>*  is  an  adaptive  test. 

4.  When  an  adaptive  test  exists,  then  the  test  defined  in  (2.2)  is  always  adap¬ 
tive.  However,  an  overall  maximum  likelihood  ratio  test,  i.e.  a  test  with  critical 
region  {x  :  maxa  n"=i  ?<»(*>)/ maxa  n?=i  pa(x>)  >  e*10"},  for  some  constant  cn,  is 
not  necessarily  adaptive  even  when  an  adaptive  test  exists.  Let  4>n  denote  such  a 


\ru  i.'w  '.-v t.%  '.  v  *.  <. 


test.  If  c„  =  maxjk=a,^  Cag,  then  it  can  be  shown  that  <£„  is  a  test  of  rate  Aa  for 
each  a.  If  Aa,  a  =  1, . . . ,/  are  picked  such  that  Cn  =  •  •  •  =  Cu,  then  a  sufficient 
condition  for  the  test  4>n  to  be  adaptive  is  that  Bag  >  Bgg+ta(C  —  Cag)  where  C  = 
ma xa<gCag,  ta  =  maxptpa,  and  tga  is  the  point  where  - tCag  +  \ogxl)(t\Pa,  Qg) 
attains  its  minimum. 
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3  Example 

Let  Pa,Qa  belong  to  an  exponential  family  with  densities  pa,qa  given  by 

Pcr(s)  =  exp{^x  -  x(ffl)}» 

qa(x)  =  exp {q'ax  -  x{Vc)}- 

Let  g[t,u)  =  —  tu  +  \ogrp{t\Pa,Qp).  By  a  straightforward  calculation, 

rp{t\Pa,Qg)  =  J exp  t{r)'pi  —  £ax  —  xivp)  +  x(£c<)}  exp{^x  —  x(sa)}dx 

=  exP{— (1  -  t)x{Za)  -  txM  +  x{tr}0  +  (1  -  t)U)}. 

Thus,  g{t,u)  =  -tu  -  (I  -  t)x{£a)  -  tx(np)  +  x{tVp  +  (1  -  t)£a).  Therefore  we 
have 

g'{t)  ~  -u  +  x(£a)  -  x{np)  +  xitvp  +  (1  -  t)£a), 

where  g',x  are  derivitives  of  g,x  with  respect  to  t. 

If  sag  satisfies 

sa0x{sapVe  +  (1  -  sag)^a)  -  x{sa0r)0  +  (1  -  sag)^a)  +  x(f»)  =  Aa,  (3.1) 


and  let 


Cag{Aa)  =  x{rip)  ~  xUa)  ~  X{saprip  +  (1  -  sag)^a), 


then  g(sa0,Ca0)  =  -Aa  and  g'{sag,Ca0)  =  0. 

Suppose  0  <  Aa  <  mi ng  K(Qg,  Pa),  for  each  a,  then  an  adaptive  test  exists 
iff 

Ac  -  x(vp)  +  x(6»)  +  x'{sa0T]0  +  (1  -  Sc0)Za) 

>Ag-  xitfp)  +  xU/j)  +  x'{spV0  +  (1  -  8fi)Zp) 


X[£a)  -  X(£tf)  +  X  {sa0VP  +  (1  —  5 a/jKa)  -  X  (■S>9r7/9  +  (l  ~  Sg )£g)  >  Ag  —  Aa.  (3.3) 


I 

E 


Suppose  Pa  ~  N(6a,l),Qa  ~  N(fj,a,  1),  then  K(Qp,Pa)  -  2~1(n0  -  6a )2  and 

X(^  +  (1-‘)W  =  |(*/i/»  +  (l -<)««)*. 

x'(*»7/J  +  (1  ~0&»)  =  (*M*  +  (1  -  *)0<O(M/3  -  *a). 

It  is  easy  to  check  that  sap  =  y  satisfies  (3.1),  and  it  follows  from  (3.2) 

that 


Caf)(Aa)  — 


{Hfi  ~  0a)2  (  2v/2Al 


/  2v/2> 

VlM/f- 


-1  ■ 


Thus,  if  0  <  <  min^  2  x(/xg  —  0a)2  ,  then  an  adaptive  test  exists  iff  for  all 

a//? 

("“ “ K)1  " 2) " ^ _ *’s)I  " 2)  -  A> ~ A° ■  (3 4) 

For  example,  when  6\  =  — 1,/ii  =  1;  ^2  =  —1.5,  /z2  =  0.5,  Ax  =  0.5,  Ai  = 
1.125,  then  Cn  =  0,Ci2  =  0.375,  C21  =  0.625,  C22  =  1  and  the  above  condition 
is  satisfied.  (Here  Bn  =  B2i  =  0.5, £22  =  -®i2  =  0.125). 

Consider  the  following  overall  maximum  likelihood  ratio  test  with  the  above 
parametric  values: 

1  ,  maxa=j,i  riy=i  ?“(*/)  v. 

1  if  n  1  log - -fft— — .  >  C 

6  maxa=i,j  Hy_,  Pa[*j)  - 

0  otherwise. 

If  the  critical  constant  C  is  chosen  such  that  C  =  max^  Cap(Aa)  =  1,  then  <i>n  is 
a  test  of  exponential  rate  Aa  for  a  =  1,2.  Now,  consider  the  rate  of  convergence 
of  the  probability  of  type  two  error: 


fftWV 

/Pfc(x)V\ 

Wi(x)/ 

U(*)y  j  ‘ 

(3.5) 

When  a  —  2, 

^(SwHsw)'  =  +  •)(»*- <*.)’  + 

2 t{9k  -  Mi)(Mi  -  M2)  -  2 st($k  -  H2)[0k  -  Mi)}- 

Consider  k  =  1  and  let  the  expression  in  the  parenthesis  of  (3.5)  be  g{s,t),  i.e. 
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g{s,t)  =  s  +  t - 1(  1  -  t)  -  2s(l  -  s)  +  s  +  3sf. 


By  differentiating  g  with  respect  to  s  and  t,  one  can  show  that  ( d/ds)g  and 
[d/dt)g  do  not  vanish  simultaneously  and  therefore 

urfff(M)  =  min{inf  ff(s,0),inf  g{0,t)}. 

By  a  straightforward  calculation,  inf4>t>o<7(s,t)  ~  —.0035.  Hence, 

lim  n-1  log £  \  >  -.125  =  - £2 , 

and  it  follows  that  <fn  is  not  an  adaptive  test. 

Note  that  in  this  example,  the  critical  constant  C  =  1  is  the  ‘best’  in  the 
sense  that  <£„  is  a  test  of  exponential  rate  Aa  fo  reach  a.  If  C  is  replaced  by 
c„  in  the  definition  of  <fn  such  that  lim  inf„— cn  =  C'  <  1,  then  by  a  similar 
calculation  as  above,  one  can  show  that  limsupn_0O  n-1  log  Ej>4>n  >  —A2. 
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